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Section  1 


INTRODUCTION 


1.0  Background 

It  is  the  policy  of  the  U.S.  government,  through 
the  Agency  for  International  Development  to : 

1.  Render  emergency  relief,  in  coordination  with 
other  governments,  international  agencies,  and  voluntary 
organizations,  to  victims  of  natural  and  man-made  foreign 
disasters.  Such  assistance  can  be  provided  to  the  people 

of  any  nation  affected  by  disasters  and  must,  to  the  greatest 
extent  possible,  reach  those  areas  most  in  need  of  relief 
and  rehabilitation. 

2.  Monitor  all  potential  and  actual  disaster 
situations. 

3.  Assist  in  rehabilitation  when  such  rehabili¬ 
tation  is  beyond  the  capacity  of  local  resources. 

4.  Encourage  and  participate  in  foreign  disaster 
preparedness  through  the  provision  of  technical  assistance 
and  international  training  programs. 

5.  Where  there  has  been  severe  social  and  economic 
disruption,  consider  on  a  case-by-case  basis  longer  term 
reconstruction  assistance  and  implement  the  program  as  a 
development  tool. 

6.  Support  the  efforts  of  international  organiza¬ 
tions  and  voluntary  agencies  involved  in  foreign  disaster 
assistance. 


7.  Increase  U.S.  technical  capacity  to  define 
disaster-prone  conditions  and  to  recommend  disaster- 
avoidance  measures. 

8.  Initiate,  within  international  fora,  efforts 
to  increase  other  donor  participation  in  disaster  pre¬ 
paredness  and  disaster  relief  activities. 

With  regard  to  cyclones  in  the  Bay  of  Bengal, 
the  research  reported  herein  supports  the  U.S.  policy  ob¬ 
jectives  above.  To  some  extent  all  the  above  policy 
objectives  are  supported  but  the  primary  emphasis  is  on 
monitoring  (objective  #2),  disaster  preparedness  (#4),  and 
increasing  technical  capacity  to  define  disaster  prone 
conditions  and  to  recommend  disaster-avoidance  measures  (#7). 


The  Tropical  Cyclone  Problem 


Tropical  cyclones  include  the  hurricane  (in 
oceans  bordering  North  America),  typhoons  (north  western 
Pacific  Ocean)  and  the  cyclones  of  the  South  Pacific  and 
Indian  Oceans  including  the  Bay  of  Bengal  and  Arabian  Sea. 
Historically  the  great  disasters  have  been  in  the  Bay  of 
Bengal.  The  November  1970  Bangledesh  cyclone  is  estimated 
to  have  killed  over  200,000  people  (ESCAP,  LRCS,  WMQ  1977) 
and  the  November  1977  Andhra  Pradesh  cyclone  killed  perhaps 
20,000. 

^  The  problem  in  the  Bay  of  Bengal  is  partly 
attributable  to  the  distribution  of  population  in  low 
lying  and  unprotected  areas  along  the  bay,  but  more  im¬ 
portant  is  the  configuration  of  the  bay  which  results 
in  large  cyclone  induced  storm  surges  (often  incorrectly 
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referred  to  as  tidal  waves).  These  surges  are  an  elevation 
of  the  sea  surface  because  of  the  ^barometer  effect^ 

(pushing  up  the  water  into  the  cyclones  central  low  pressure) 
combined  with  the  buildup  of  wind  driven  water  along  the 
coast.  These  are  superimposed  on  the  astronomical  tides 
which  have  a  12-hour ly  period  (two  highs  and  two  lows  per 
day)  and  a  large  tidal  range  at  least  with  some  combinations 
of  the  solar-lunar  cycles.  An  unfortunate  coincidence  of 
a  large  storm  surge  and  high  tide  can  increase  the  mean 
water  level  by  several  meters,  thus  inundating  large 
coastal  areas  with  devastating  effects^. 

The  great  killer,  then,  is  the  storm  surge. 

While  this  work  does  not  deal  with  storm  surge,  it  does 
deal  with  cyclone  winds  which  directly  (but  not  exclusively) 
determine  the  storm  surge.  This  work  also  involves  the 
introduction  of  probability  into  interpreting  cyclone 
forecasts  in  time  of  threat. 

Forecasts  tell  in  very  specific  language  where 
the  cyclone  will  be,  at  what  time,  and  describe  its  con¬ 
figuration  (size  and  wind  distribution).  If  it  were  not 
for  inaccuracies  in  these  forecasts ,  specifying  the  impact 
of  a  cyclone  on  a  locale  would  be  rather  straightforward; 
however,  inaccuracies  are  a  fact  of  life  even  with  advanced 
forecasting  capability . Forecast  errors  have  gradually 
been  reduced  over  the  past  few  decades,  but  still  they 
persist  and  their  reduction  seems  to  have  leveled  off  in 
the  decade  of  the  seventies  (Jarrell  et  al  1978,  Neumann 
1978).  The  improvement  was  most  pronounced  in  the  regions 
of  the  world  where  observation  improved.  This  was  mostly 
post  WWII  aircraft  reconnaissance  supplemented  increasingly 


after  1964  by  meteorological  satellites.  In  the  Bay  of 
Bengal  the  satellite  era  is  just  emerging,  thus  we  may 
expect  to  see  improvement  in  forecasting  capability  there. 

/ 

Within  a  few  years  forecast  accuracies  may 
approach  those  of  the  Atlantic  and  Eastern  Pacific  hurri¬ 
canes  and  the  Western  Pacific  typhoons.  What  we  are  doing 
here  is  attempting  to  make  current  forecasts  with  their 
inherent  inaccuracies  more  usable.  Barring  unforeseen 
dramatic  improvement  in  forecast  accuracy  this  will  be  a 
continuing  need. 

.i^The  aim  of  this  research  was  to  develop  a  reliable 
estimate  of  the  probability  of  40,  65  and  100  kt  winds  for 
points  under  threat  of  a  tropical  cyclone. 
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Section  2 


USE  OF  PROBABILITY 

2 . 0  Choice  Between  Two  Alternatives 


We  use  probability  as  a  means  of  quantifying  the 
risk  of  an  event  occurring.  Often  events  can  be  expressed 
as  binary  outcomes,  a  choice  of  two.  The  event  will  or 
will  not  occur.  In  this  context,  for  a  given  case  the  real 
probability  (presently  unknown)  is  either  0  (the  event  will 
not  occur)  or  1  (the  event  will  occur).  Any  other  outcome 
is  impossible. 

If  we  take  a  long  term  perspective  of  the  prob¬ 
lem  then  a  number  between  0  and  1  can  represent  the 
proportion  of  a  large  number  of  like  cases  which  will  re¬ 
sult  in  the  event  occurring.  It  is  this  point  of  view  that 
is  usually  advocated  in  decision  theory.  The  techniques 
used  are  those  which  maximize  the  long  term  outcome,  not 
necessarily  in  the  immediate  decision  at  hand.  For 
example  if  evacuation  is  considered,  all  the  costs,  both 
monetary  and  human,  must  be  weighed  against  the  savings. 

The  following  loss  table  illustrates  the  trade¬ 
off  between  evacuation  and  non-evacuation. 
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Preparation  Outcome 


Actions 

Hit 

Miss 

Costs  of 

Costs  of 

Evacuate 

Evacuation  (C) 

Evacuation  (C) 

Do  not  evacuate 

Avoidable 

None 

Losses  (L) 

CONTINGENCY  LOSS  TABLE 

If  we  want  to  minimize  probable  losses  we  will 
want  to  evacuate  only  when  the  probable  loss  with  evacuation 
is  less  than  the  probable  loss  without  evacuation.  Note 
that  unavoidable  losses  are  not  a  relevant  part  of  the 
problem. 


If  P  is  the  probability  of  a  "hit"  of  sufficient 
magnitude  to  necessitate  evacuation  then  the  expected  or 
probable  losses  with  evacuation  would  be  C  and  those  with¬ 
out  evacuation  P  x  L.  We  want  to  order  evacuation  only  if 
C  <  P  x  L  or,  rearranging,  we  evacuate  when  P  >  C/L. 

To  illustrate  this  principle,  suppose  a  boatowner 
is  considering  moving  his  boat  to  an  inland  shelter.  Let's 
say  the  boat  is  worth  $10,000  and  it  costs  $100  to  move  it. 
With  C  *  100,  L  ■  10,000,  he  would  not  want  to  move  it  un¬ 
less  the  probability  (P)  of  its  being  lost  exceeded  the  ratio 
of  these  numbers: 


P  >  C/L  »  1% 


Obviously  in  real  world  situations  life  is  not 
that  simple.  We  have  great  difficulty  putting  dollar  values 
on  both  evacuation  costs  and  losses  because  of  a  host  of 
complexities.  Note  that  it  is  necessary  that  both  C  and 
L  be  expressed  in  the  same  units,  but  not  necessarily 
monetary  units.  They  could,  for  example,  be  human  lives 
although  it  requires  some  innovation  to  express  costs  of 
preparation  in  those  terms.  One  way  which  has  been  sug¬ 
gested  is  through  loss  of  credibility  in  the  warning  systems. 
That  is,  if  evacuation  is  ordered  unnecessarily  and  re¬ 
peatedly  ("crying  wolf"),  it  becomes  increasingly  difficult 
to  affect  an  evacuation  because  of  reluctant  public  response. 
Thus  evacuating  uses  up  credibility  and  hence  has  a  future 
loss  of  lives  (when  the  real  wolf  appears)  as  its  price. 

The  condition  (P  >  C/L)  is  offered  as  a  necessary 
condition,  that  is,  .do a.’. t  act.  unless  this.. condition.. is  met... 
It  is  not  sufficient,  meaning  when  this  condition  has  been 
met  there  are  still  other  factors  to  consider  before  acting. 
For  example,  suppose  the  boatowners  criteria  was  met  in 
that  there  was  a  greater  than  one  percent  probability  of 
destructive  conditions  occurring  three  days  from  now.  If 
it  only  takes  a  few  hours  to  move  the  boat,  he  should  wait. 
Severe  tropical  cyclone  damage  is  a  rare  event,  if  we  have 
a  probability  of  occurrence  of  1%,  then  we  have  a  prob¬ 
ability  of  non-occurrence  of  99%,  If  the  boat  owner  waits 
a  day  or  so,  in  most  cases  the  threat  will  subside.  Simply 
stated  this  principle  is  that  we  should  put  off  action 
until  we  have  just  enough  time  to  complete  the  action  before 
the  event  occurs.  In  this  connection,  one  must  not  overlook 
the  reality  of  darkness  and/or  the  onset  of  inclement  weather 
ahead  of  the  approaching  cyclone  as  factors  in  slowing  any 
action. 
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2.1 


Choice  Between  Three  or  More  Alternatives 


The  above  extends  easily  to  choosing  between 
three  alternate  courses  of  action.  Consider  the  following 
example  of  a  medium  sized,  and  hypothetical,  police  force 
which  will  man  various  emergency  posts  dependent  upon 
which  of  3  hurricane  events  is  forecast.  We  assume  the 
most  likely  (the  mode)  will  be  forecast. 

Minor  event  requires  2  man  days 
Moderate  event  requires  10  man  days 
Major  event  requires  50  man  days 

There  are  "penalty"  costs  associated  with  either 
underestimation  or  overestimating  the  requirements  which  are 
given  in  the  following  cost  table.  The  elements  on  the 
diagonal  represent  the  cost  of  correct  manning,  and  those 
off  the  diagonal  represent  the  cost  of  either  over  or  under 
manning. 


ACTUAL  OCCURRENCE 


ACTION  OPTIONS 

MINOR 

MODERATE 

MAJOR 

1 

Man  for  minor  event 

2 

17 

97 

2 

Man  for  moderate  event 

11 

10 

85 

3 

Man  for  major  event 

60 

55 

50 

Cost 

;  contingency  table  for 

hurricane 

manning  (man 

days) 

A  rational  decision  is  one  which  minimizes  the 
expected  cost.  If  we  can  estimate  the  probabilities  of 
each  outcome  occurring  P^,  P2,  P3  then  the  expected  cost 
if  we  use: 


Option  1  is  C1  =  2xP1  +  17xP2  +  97xP3> 

Option  2  is  Cj  =  llxP^  +  10xP2  +  85xP3>  and 
Option  3  is  C3  =  60x1?^  +  55xP2  +  50xP3 

For  example  suppose  P^  =  .45,  P2  +  .35  and  Pg  =  .20. 
Note  that  we  assume  no  other  outcome  is  possible  (minor 
includes  no  event)  P^  +  P2  +  P3  =  1.00. 

C1  =  2x.45  +  17x.35  +  97x.20  =  26.25 

C2  =  llx.45  +  lOx.35  +  85X.20  =  25.45 

C3  =  60X.45  +  55X.35  +  50x.20  =  56.25 

Since  C2  is  the  course  of  action  with  minimum 
expected  cost,  it  should  be  selected.  Notice  that  the 
minor  event  is  most  likely  to  occur  but  in  this  case,  the 
best  bet  is  slight  over  preparation.  The  difference  in 
C-,  and  C0  may  be  trivial,  but  certainly  either  is  preferable 
-C3. 


Figure  1  summarizes  this  problem  in  three  graphical 
depictions.  Figure  la  shows  a  lxl  graph  of  P^  vs  P2>  Note 
for  any  P^ ,  Pg  combination,  a  value  of  P3  is  determined 
since  P3  =  1  -  P^  -  P2<  Thus  in  the  lower  left  corner  P^ 
and  P2  are  small,  thus  P3  is  near  1.  The  space  blocked  off 
in  the  lower  left  is  the  region  where  event  3  (major  hurri¬ 
cane  event)  is  more  likely  than  either  events  1  or  2, 
similarly  the  upper  left  and  lower  right  represent  the 


Figure  la.  Illustrates  sec¬ 
tions  of  a  1x1  probability 
square  wherein  events  1,  2 
or  3  are  the  mostlikely  of 
the  three  mutually  exclusive 
events  which  are  also 
exhaustive  (P^P  +P3  *  1.0) 


Figure  lb.  Illustrates  sec¬ 
tions  of  a  lxl  probability 
square  wherein  the  expected 
cost,  is  minimized  by  plan¬ 
ning  for  events  1,  2  or  3. 


Figure  1c.  Combines  figures 
la  and  b.  Illustrates  con¬ 
ditions  under  which  over¬ 
preparation  (vertical  hatching) 
and  underpreparation  (black) 
minimizes  expected  cost. 

Number  pairs  ( ,  N2)  are 

minimum  expected  cost  event, 
most  likely  event. 


combinations  wherein  events  1  and  2  respectively  are  the 
most  likely  outcome.  Notice  that  combination  of  P^,  P2 
in  the  upper  right  triangle  do  not  exist  since  P^  +  P2  _<  1. 

Figure  lb  is  a  graphical  representation  of  all 
possible  combinations  of  P^,  P2  and  the  minimum  expected 
cost  of  each  for  the  police  department  problem.  Note 
there  is  a  similarity  between  figures  la  and  lb.  Near 
the  corners  where  the  outcome  is  fairly  certain,  the  most 
likely  outcome  is  the  best  one  to  plan  on;  however,  in  the 
middle  region  that  is  not  true. 

Figure  lc  combines  figures  la  and  lb.  In  the 
area  with  vertical  cross-hatching,  the  most  likely  event 
to  occur  is  one,  a  minor  event;  however  the  expected  cost 
is  less  in  this  region  if  we  provide  more  manpower  than 
that  which  is  most  likely  required.  In  the  shaded  regions, 
the  least  expected  cost  occurs  when  we  underman. 

This  type  argument  can  be  extended  to  any  number 
of  possible  courses  of  action,  although  the  computations 
become  laborious.  Graphical  solution  (of  the  type  illustrated 
here)  is  restricted  to  3  or  less.  A  programmable  calculator 
can  nicely  handle  up  to  5  or  6  options. 

The  difficult  part  of  applying  such  methods  is 
obtaining  the  probabilities.  Providing  the  probabilities 
is  the  subject  matter  of  this  research. 
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2.2 


Basis  for  Probabilities 


In  the  Bay  of  Bengal  probabilities  are  available 
based  on  climatology.  For  example,  Neumann  and  Mandal 
(1978)  describe  an  analog  scheme  which  models  such  a 
probability.  This  probability  is  solely  based  on  clima¬ 
tology  biased  to  persistence.  To  the  extent  that  the 
forecaster  can  improve  on  climatology,  probabilities  based 
on  his  forecast  will  be  an  improvement  over  climatological 
probabilities.  By  improvement  we  mean  probabilities 
followed  by  the  events  actual  occurrence  will  be  larger 
and  those  followed  by  actual  non-occurrence  will  be  smaller, 
with  diminished  occurrence  of  those  in  the  middle.  This 
means  the  users  critical  probability  (P  =  C/L,  see  section 
2.0)  will  be  exceeded  less  often  in  non-hit  cases.  Since 
the  forecaster  can  take  into  account  not  only  climatology  and 
persistence,  but  also  synoptic  factors  and  the  analog 
scheme  itself,  he  should  ususally  beat  the  analog. 
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Section  3 

THE  MODEL 

3.0  Statistical  Model  Basis 

The  probability  estimation  model  is  based  on  a 
study  of  tropical  cyclone  forecasts  issued  by  the  Joint 
Typhoon  Warning  Center  (JTWC)  on  Guam  during  the  7  years 
beginning  with  1971.  That  was  the  year  when  the  JTWC  began 
forecasting  in  the  Bay  of  Bengal. 

The  particular  forecasts  were  205  motion  and 
maximum  wind  forecasts  for  cyclones  in  the  north  Indian 
Ocean;  however,  there  were  only  137  forecasts  where  the 
nowcast  position  was  actually  in  the  Bay  of  Bengal.  This 
number  of  forecasts  is  barely  adequate  to  support  a  statis¬ 
tical  study.  In  a  similar  motion  forecast  study  for  Western 
Pacific  typhoons,  Nicklin  (1977)  had  over  5000  cases. 
Jarrell  (1979)  studied  wind  forecast  errors  also  in  the 
western  Pacific  and  had  a  sample  of  over  2000  cases.  The 
large  difference  in  sample  size  is  somewhat  reduced  because 
the  Bay  of  Bengal  forecasts  were  issued  at  12-hour  intervals 
vs  6-hour  in  the  Western  Pacific,  thus  consecutive  forecasts 
are  more  nearly  independent.  Additionally,  the  general 
characteristics  of  the  error  distributions  are  known  to  a 
good  approximation  from  these  and  other  earlier  studies. 

This  study  was  more  to  confirm  similarity  rather  than 
break  new  ground. 

An  attempt  was  made  to  stratify  forecasts  into 
difficulty  classes.  The  most  successful  stratification  was 
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on  the  basis  of  forecast  direction  of  motion.  Errors  are 
usually  smaller  for  cyclones  moving  west  and  larger  for 
cyclones  moving  northeast.  These  directions  represent  typi¬ 
cal  tracks  before  and  after  recurvature.  Recurvature  is  a 
term  signifying  a  transfer  from  control  by  the  near  equator 
easterly  air  currents  to  the  westerly  currents  of  the  mid¬ 
latitudes.  Prerecurvature  tracks  in  the  easterlies  are 
typically  westnorthwest  while  post  recurvature  tracks  are 
typically  toward  the  northeast.  The  westerlies  are  much 
stronger  and  hence  cyclone  forward  speeds  after  recurvature 
are  much  greater.  Larger  errors  are  associated  with  larger 
forward  speeds.  The  best  directional  separation  occurred 
at  about  340°  (northnorthwest ) ,  i.e.,  directions  from  340° 
to  180°  appeared  to  behave  differently  from  the  remainder 
of  the  cyclones.  Some  statistical  summary  results  are 
shown  in  Table  1.  The  group  with  headings  340°  clockwise 
to  180°  consists  mainly  of  post  recurvature  cases  and  is 
shown  as  Sector  1  in  Table  1.  Sector  2  forecasts  (pre- 
recurvature-  headings  180°  to  340°)  are  the  most  common 
forecasts.  In  Sector  1  the  mean  W-E  error  is  somewhat 
positive  (east)  while  the  mean  S-N  error  is  significantly 
positive  (north),  since  these  forecasts  are  typically  for 
north  to  northeast  motion,  this  represents  a  speed  over¬ 
forecast.  For  Sector  2,  the  W-E  mean  error  is  significantly 
negative  (west),  while  the  mean  S-N  error  is  slightly 
positive  (north).  Again  these  are  over  forecasts  in  speed 
along  the  track.  These  speed  errors  may  in  part  be  attribu¬ 
table  to  the  lack  of  a  good  climatology  for  the  area  and 
hence  the  Guam  forecaster  relies  on  his  experience  with 
faster  moving  Pacific  typhoons.  For  this  sample,  the 
average  forward  speed  was  5.4  kts,  if  we  add  the  average 
24  hour  speed  error  (2.9  kts)  to  that,  we  arrive  very  close 


to  the  average  typhoon  forward  speed  of  nine  kts.  This 
appears  to  be  a  correctable  bias.  Without  this  bias,  there 
appears  to  be  no  significant  difference  in  the  difficulty 
classes,  hence  an  artificial  set  of  statistics  based  upon 
the  removal  of  this  bias  is  used  in  the  model  and  the 
directional  discrimination  is  eliminated. 

This  permits  the  pooling  of  cases  for  maximum 
statistical  stability.  The  correlation  coefficients  are 
of  some  passing  interest.  The  correlation  between  the 
error  components  is  small  but  comparable  to  those  found 
in  the  western  Pacific  by  Nicklin  (1977)  and  in  various 
studies  (see  for  example  Neumann,  1975,  and  1978).  Notice 
the  small  correlation  between  the  error  in  maximum  winds 
and  displacement  error  components.  Since  none  of  these 
in  the  pooled  sample  are  significantly  non-zero,  these 
errors  will  be  treated  as  independent  in  the  model. 

While  we  are  satisfied  with  the  stability  of  the 
forecast  error  statistics,  we  would  have  preferred  a 
longer  period  of  record.  We  have  also  seen  a  rather  severe 
bias  in  the  Guam  forecasts  which  we  assume  will  be  corrected. 
The  presence  of  this  bias  serves  to  flag  the  risk  in 
applying  statistics  derived  from  forecasts  from  one  source 
to  forecasts  of  another  source.  For  this  reason  we  recom¬ 
ment  that  the  statistical  package  be  derived  from  and  tailored 
for  the  driving  forecasts.  For  example,  if  one  of  the 
nations  on  the  Bay  chooses  to  adapt  this  model  relative  to 
their  own  forecasts,  a  statistical  package  derived  from 
their  forecasts  should  be  substituted  for  the  Guam  statistics. 
In  some  cases  this  may  also  provide  a  more  extensive  basis. 
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Model  Operation 


Like  most  models  the  wind  threat  model  can  be 
thought  of  in  three  stages:  Input,  computation  and  output. 
Input  and  output  are  perhaps  of  most  concern  to  the  user 
because  of  their  visibility,  but  the  important  work  goes 
on  in  the  computation  stage.  It  is  there  that  the  under¬ 
lying  mathematical  relationships  are  expressed  and  exercised 
and  it  is  there  that  any  simplifying  assumptions  are  made. 
The  latter,  together  with  the  input,  determine  the  validity 
of  the  output.  The  following  description  provides  infor¬ 
mation  which  the  user  needs  to  understand  in  order  to  fully 
appreciate  the  output  information. 


3.1.1  Input 

The  input  is  taken  exclusively  from  the  JTWC  cy¬ 
clone  warnings.  It  consists  of  cyclone  identification  infor¬ 
mation,  used  for  output  labelling,  and  forecasts  of  latitude, 
longitude  and  maximum  wind  at  0,  24  and  48  hours  after 
forecast  valid  time.  Figure  2  illustrates  an  actual  fore¬ 
cast  of  tropical  cyclone  17-79  originated  by  the  JTWC  at 
0800  GMT  on  11  May  1979.  The  bottom  line  in  figure  2  is 
the  necessary  input  information  extracted  from  the  warning. 
The  information  (except  the  second  entry,  month:  5  *  May) 
is  underlined  in  the  warning.  This  cyclone  warning  will 
be  used  again  as  an  output  example. 

3.1.2  Computations 


The  actual  computations  are  carried  out  on  a 
grid  of  points  spaced  at  60  nmi  intervals  along  the 
periphery  of  the  Bay  of  Bengal  and  along  the  Andaman  Island 


17 


mx3i  pgtw  111000 

TROPICAL  CYCLONE  17- T9  WRNG  NR  20 
POSIT  13. 2N6  082. 3E3  at  110800Z 
ACCURAfTTlTHI.V  40  NM 
BASED  ON  EYE  FIXED  AT  13.3N7  082. 7E7 
AT  110613Z  BY  SATELLITE 

PRESENT  MOVEMENT:  WEST-NORTHWEST  AT  05  KTS 
PRESENT  WIND  DISTRIBUTION: 

MAE  SUSTAINED  WINDS  90  KTS  NEAR  CENTER  WITH  GUSTS  TO  110  KTS 

RADIUS  OF  OVER  SO  KT~llNDS  75  NM 

RADIUS  OF  OVER  30  KT  WINDS  150  NM  OVER  WATER 

REPEAT  POSIT  13.2N6  082. 3E3  at  110800Z 

FORECASTS : 

12  HRS  VALID  112000Z  13.8N2  081. 5E4 
MAX  WINDS  100  KTS  WlTS“STJsTS  TO  '125  KTS 
RADIUS  OF  OVSR  50  KT  WINDS  80  NM 
24  HRS  VALID  120800Z  14.2N7  080. 5E3 
MAX  WINDS  121  KTS  WI'lSTBSTS  TO "130  KTS 
RADIUS  OF  OVER  50  KT  WINDS  90  NM  OVER  WATER 
RADIUS  OF  OVER  30  KT  WINDS  175  NM  OVER  WATER 
EXTENDED  OUTLOOK: 

4&  HRS  VALID  130800Z  14. 7N2  078.9E4 
MAX  WINDS  21  KTS  WITHTTCSTS  TO  45  KTS 
DISSIPATING  OVER  LAND 

NEXT- WARNINGS  AT  111600Z.  112200Z,  120400Z  and  121000Z 
REMARKS:  LATEST  SATELLITE  DATA  INDICATES  TC  17-79  HAS  CONTINUED 
TO  INTENSIFY  OVER  THE  PAST  12-24  HOURS,  WITH  SLOW  INTENSIFICATION 
EXPECTED  UNTIL  LANDFALL.  TC  17-79  HAS  SLOWED .TO  05  KTS,  HENCE,  AN 
ADDITIONAL  06  HOURS  WAS  ADDED  TO  THE  WARNINGS  VALID  PERIOD.  TC17-79 
CONTINUES  TO  OSCILLATE  ABOUT  AN  OVERALL  WEST-NORTHWEST  TRACK,  HENCE, 
THE  FIX  POSITION  WAS  NOT  USED  VERBATIM. 

BT 

"17-79”,  5,  1108,  132,  823,  90,  138,  815,  100,  147,  789, 

30,  48 


Figure  2.  An  actual  cyclone  warning  issued  by 
the  Joint  Typhoon  Warning  Center  on 
Guam  for  Cyclone  17-79  on  110800  GMT 
May  1979.  The  added  line  across 
the  bottom  is  the  extracted  model  in¬ 
put  . 
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Chain.  These  computations  are  executed  at  3-hour  time 
steps  from  forecast  valie  (nowcast)  time  to  48  hours  hence. 

The  following  assumptions  are  implicit  in  the  computations. 

(a)  That  the  forecast  represents  the  mean 
of  all  possible  outcomes,  that  the  deviation  of  the  actual 
position  from  this  mean  is  a  random  variable  pair  described 
by  a  bivariate  normal  frequency  distribution  whose  para¬ 
meters  are  given  in  Table  1. 

(b)  That  the  actual  maximum  wind  is  a 
normally  distributed  random  variable  about  the  forecast, 
with  parameters  given  in  Table  1. 

(c)  When  landfall  is  forecast,  the  accom¬ 
panying  reduction  in  the  maximum  wind  forecast  is  solely 
attributable  to  land  influence,  otherwise,  a  trend  estab¬ 
lished  prior  to  landfall  would  have  continued.  If  no 
trend  can  be  inferred  from  the  forecast,  it  is  assumed  the 
nowcast  wind  would  have  continued  in  the  absence  of  landfall. 

(d)  That  probabilities  can  be  adequately 
interpolated  in  space  between  representative  points 
spaced  60  nmi  apart . 

(e)  That  the  forecast  positions  and  the 
statistical  parameters  valid  for  0,  24  and  48  hours  can  be 
interpolated  to  3-hour  time  steps  and  further  that  linear 
interpolation  of  probabilities  between  3-hour  time  steps 
is  valid. 

(f)  That  probabilities  can  be  summed  over 
time,  i.e.,  the  probability  of  an  event  occurring  within 

a  three-hour  timestep  is  the  sum  of  the  probabilities  at 
the  two  end  points  less  the  probability  of  an  occurrence 
at  both  times.  That  the  probability  of  an  occurrence  at 
both  times  can  be  determined  from  a  geometric  parameterization 
of  probability  along  the  forecast  track. 


(g)  That  wind  errors  and  forecast  position 
errors, not  withstanding  the  landfall  case  in  (c)  above, 
are  independent. 

(h)  That  the  shape  of  the  mean  wind  radial 
profile  is  similar  to  that  of  Western  Pacific  typhoons 
and  is  realted  to  maximum  wind  speed. 

3. 1.2.1  Validity  of  Assumptions 

The  validity  of  all  the  foregoing  assumptions 
has  not  been  established  herein,  nevertheless  there  is 
considerable  evidence  to  support  most  of  them. 

The  concepts  expressed  in  assumptions  a  and  b 
have  been  firmly  established  in  the  development  of  the  U.S. 
Navy  Pacific  typhoon  STRIKP  and  WINDP  programs  (Jarrell, 
1979).  The  actual  values  of  the  statistical  parameters  in 
Table  1  are  subject  to  error.  This  can  reasonably  be  as 
great  as  10%  in  the  important  standard  deviations.  As  an 
illustrative  example  of  the  impact  of  a  10%  error,  we  first 
estimated,  for  comparison,  the  probability  that  a  cyclone, 
after  24  hours,  would  actually  be  within  circles  of  radius 
50  and  100  nmi  centered  on  a  24  hour  forecast. 

The  probabilities  of  the  cyclone  actually  being 
within  these  circles  (where  it  is  supposed  to  be)  are  11 
and  36%  respectively.  To  demonstrate  that  these  are 
reasonable,  we  examined  the  24  hour  forecast  errors  for 
1978  (independent  data)  for  comparison.  There  were  only 
28  such  forecasts,  but  of  those  14  and  39%  actually  verified 
within  50  and  100  nmi  respectively  of  the  24-hour  forecast 
point.  We  estimate  that  any  point  100  miles  removed  from 
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the  forecast  point  has  2/3  the  chance  of  being  struck  as 
does  the  forecast  point  and  a  point  200  miles  away  has  1/5 
as  great  a  chance.  It  is  not  true  (as  has  been  stated) 
that  the  forecast  point  is  the  safest  place  to  be,  but  it 
is  also  clear  that  a  great  many  other  points  are  also 
threatened.  Being  able  to  quantify  that  threat  is  the 
unique  capability  of  this  model. 

To  simulate  the  effect  of  a  10%  error  in  the 
standard  deviations  we  computed  several  probabilities  using 
standard  deviations  of  90%,  100%  and  110%  of  those  in 
Table  1.  The  probabilities  estimated  are  for  a  cyclone 
being  within  circles  of  radius  50  and  100  nmi  centered  on 
the  forecast  point  (as  before)  and  removed  to  the  Northwest 
distances  of  100,  200  and  300  nmi.  These  estimates  are 
given  in  Table  2. 


CIRCLE 

RADIOS 

50  nmi 

100  nmi 


Distance  of  circle  center  NW  of  forecast  point 


0  nmi 
13-11-9 . 3 
42-36-31 


100  nmi 
7. 8-7. 1-6. 5 
28-25-23 


200  nmi 
1.8-2. 1-2. 4 
8. 2-9. 0-9. 6 


300  nmi 
.15-. 29-. 43 
1.0-1. 6-2.1 


Table  2.  Probabilities  (%)  of  cyclone  being  within  various 
circles  in  the  vicinity  of  the  24  hour  forecast 


The  first  number  is  that  based  on  the  smaller  standard 
deviations,  the  second  number  uses  standard  deviations 
given  in  Table  1  and  the  third  is  associated  with  the 
larger  standard  deviations.  This  should  give  the  reader 


21 


some  sense  of  the  limits  on  the  accuracy  of  our  probability 
estimates.  It  is  doubtful  that  the  uncertainity  introduced 
by  imperfect  knowledge  of  the  statistical  parameters  is 
great  enough  to  be  important  for  most  purposes. 

The  above  simulation  also  provides  some  insight 
into  what  happens  to  probabilities  when  forecast  accuracy 
improves  (and  the  standard  deviation  of  the  errors  decrease). 
Those  probabilities  near  the  track  (distance  zero)  increase 
while  those  far  from  the  track  (distance  large)  decrease. 

For  perfect  forecasting,  those  along  the  forecast  track 
would  be  1.0  while  those  far  from  the  track  would  be  zero. 

Assumption  c  is  based  upon  the  author's  knowledge 
of  the  practicalities  of  forecasting  and  is  a  rather  straight¬ 
forward  mechanism  for  removing  a  foreseeable  bias. 

Assumptions  d  and  e  are  the  result  of  testing 
and  are  considered  to  represent  the  minimum  time  and  space 
model  resolution  without  significant  distortion  of  the  re¬ 
sults.  Finer  resolution  would  not  materially  affect  the 
output,  but  for  purposes  other  than  the  present  (e.g.,  storm 
surge)  a  finer  resolution  in  both  time  and  space  may  be 
required. 


The  validity  of  assumption  f,  (time  summation) 
has  been  thoroughly  demonstrated  in  the  U.S.  Navy  models, 
over  a  wide  range  of  probabilities  and  circumstances. 

Assumption  h  is  perhaps  the  weakest  of  the  atten- 
dent  assumptions.  Unlike  the  Atlantic  and  North  Pacific, 
there  are  virtually  no  real  wind  measurements  available  in 
and  around  the  Bay  of  Bengal  cyclones.  For  this  reason 
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there  is  little  choice  but  to  assume  a  maximum  wind  deter¬ 
mined  profile.  Maximum  wind  itself  is  likewise  not  measured, 
but  is  estimated  from  satellite  imagery.  Since  maximum  wind 
is  treated  as  a  random  variable  (about  the  forecast)  then 
too  is  the  wind  profile.  There  is  little  doubt  that  real 
data  could  improve  this  aspect,  and  hence  the  wind 
probability  estimates  in  general.  The  absence  of  this  data, 
however,  is  a  more  serious  problem  with  deterministic  fore¬ 
casts  since  they  do  not  anticipate  inaccuracies  in  this  or 
any  other  forecasts. 

An  appropriate  measure  of  the  impact  of  all  of 
these  assumptions  would  be  to  test  the  model  on  indepen¬ 
dent  data.  A  meaningful  test  would  require  a  few  hundred 
cases  which  would  take  years  to  acquire.  There  appears  to 
be  sufficient  substantiation  of  the  validity  of  the  prob¬ 
abilities.  The  utility  of  this  information  was  demonstrated 
in  a  case  study  of  Cyclone  17-79  (revised). 

3.1.3  Output 

The  wind  threat  output  is  in  two  forms,  an  area- 
threat  form  and  a  point-threat  form.  These  are  illustrated 
for  cyclone  17-79  from  0800  GMT  11  May  1979  in  figure  3. 

3. 1.3.1  Darkness 


For  planning  purposes  a  simple  darkness  scale 
has  been  included  in  the  output  (see  figure  3).  This 
defines  darkness  as  1800  to  0600  LST  and  uses  a  -6  time 
zone.  Each  print  position  represents  two  hours. 

I 
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Figure  3.  Wind  Threat  Model  Output  for  Cyclone  17-79, 
0800  GMT  11  May  1979. 
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The  reason  for  the  selection  of  40,  65  and  100 
kt  winds  are  these: 

40  kts :  This  is  about  the  point  where  it 
becomes  extremely  difficult  to  perform  outdoor  tasks,  hence 
when  40  kt  winds  arrive  any  physical  preparations  that  will 
be  required  should  be  completed. 

65  kts :  This  is  about  the  wind  force  where 
significant  wind  damage  begins  to  occur  and  where  storm 
surge  first  begins  to  be  a  problem. 

100  kts:  Under  ordinary  circumstances , 
winds  in  excess  of  100  kts  can  signal  a  major  disaster. 

The  intent  here  is  to  treat  the  probability  of  winds  in 
excess  of  100  kts  as  the  probability  of  a  major  disaster 
occurring.  Obviously  there  are  a  great  many  other  contribu¬ 
ting  factors  but  this  is  a  satisfactory  first  approximation. 

3. 1.3. 3  Point  Threat 


The  wind  threat  to  a  point  is  handled  somewhat 
arbitrarily  in  a  way  which  combines  the  level  of  the  threat 
with  the  urgency  of  that  threat.  The  threat  used  here  is 
the  probability  of  at  least  65  kt  winds,  T(65).  To  avoid 
confusion  with  established  warning/watch/readiness  condi¬ 
tions  in  use  in  parts  of  the  world  a  system  of  color  codes 
is  used.  Red  represents  the  greatest,  and  the  most  imminent, 
threat  and  green  represents  a  more  remote  threat,  with 
orange  and  yellow  in  between.  The  definitions  used  herein 
are  as  follow: 
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Symbol 

Color 

T(  65 ) 

Time 

R 

RED 

>  20% 

24  hours 

0 

ORANGE 

>  10% 

36  hours 

y 

YELLOW 

_>  5% 

48  hours 

G 

GREEN 

>  2.5% 

48  hours 

* 

NONE 

2.5% 

No  limitation 

These  are  illustrated  for  points  on  the  Bay  in  figure  3 
for  Cyclone  17-79  on  11  May  1979  at  0800  GMT. 
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Section  4 


RECOMMENDATIONS 

4.1  Operational  Implementation 

The  wind  threat  estimation  model  was  designed 
as  an  iterim  step  in  a  system  to  assist  AID  in  anticipating 
disasters.  It  would  be  useful  in  its  present  state  as  a 
method  of  alerting  AID  to  impending  disasters.  In  effect, 

SAI  used  the  model  in  this  way  during  the  fall  of  1978 
and  spring  of  1979,  SAI  in  turn,  passed  the  information 
to  AID  for  evaluation.  The  weakness  is  that  it  is  currently 
necessary  to  be  aware  of  the  cyclone  before  the  program 
can  be  run.  One  possible  solution  to  this  problem  is  to 
automate  the  running  of  the  program  within  an  operational 
weather  system  when  a  cyclone  is  present  in  the  Bay  of 
Bengal.  Informally  a  member  of  the  staff  of  the  Commander- 
in  Chief,  U.S.  Forces  Pacific  (CINCPAC)  has  expressed 
an  interest  in  obtaining  the  information.  If  this  interest 
continues,  the  navy  system  which  supports  CINCPAC  might 
be  tasked  to  provide  the  information  to  both  AID  and  CINCPAC. 

4.2  Foreign  Export 

It  should  be  noted  that  the  only  thing  which 
ties  this  model  to  Guam  Warnings  is  the  statistical  package 
(Table  1).  With  a  simple  substitution,  this  model  could 
be  adapted  to  any  other  forecast.  Since  the  program  is 
rather  modest  in  time/memory  requirements,  it  could  be 
adapted  to  a  small  computer  for  export.  Thus  it  appears  to 
be  completely  adaptable  for  use  in  any  of  the  countries 


on  the  Bay  of  Bengal.  Technical  assistance  in  this  adapta¬ 
tion  can  be  provided  by  SAI  at  the  request  of  AID.  It  is 
recommended  that  this  information  be  made  available  to  foreign 
governments . 


\ 
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ABSTRACT 

Western  North  Pacific  tropical  cyclone  position  forecast  errors  for  10  years  1 1966-75)  are  statistically 
analyzed.  Variations  of  errors  versus  a  number  of  parameters  are  examined.  It  is  shown  that  a  small 
number  of  readily  available  parameters,  such  as  location,  maximum  wind  and  components  oi  motion,  can. 
with  reasonable  effectiveness,  classify  a  tropical  cyclone  forecast  as  representing  a  group  with  either  markedly 
above  or  below  average  errors.  The  annual  variations  of  forecast  errors  are  also  discussed  and  an  attempt 
is  made  to  explain  those  variations. 


1.  Introduction 

Operational  military  decision  makers  in  the  western 
North  Pacific  routinely  use  information  on  average 
tropical  cyclone  forecast  errors  in  order  to  determine 
actions  required  for  evacuation,  evasion  or  protection. 
Resulting  recommendations  impact  aircraft,  ships  and 
other  military  assets.  Because  of  the  35  tropical  cyclones 
traversing  the  western  North  Pacific  in  an  average 
year,  and  the  large  number  of  military  installations, 
decisions  are  made  frequently. 

More  refined  information  than  simple  average  fore¬ 
cast  errors  would  be  valuable  to  decision  makers.  This 
study  attempts  to  provide  such  information  by: 

1)  Developing  a  tropical  cyclone  forecast  error  data 
set  to  provide  a  basis  for  statistical  analysis  of  past 
errors  and  provide  a  benchmark  for  future  forecast 
improvements. 

2)  Providing  algorithms  for  an  estimate  of  the  errors 
in  forecasts  in  order  to  assist  western  Pacific  com¬ 
manders  in  operational  decisions  regarding  the  protec¬ 
tion  and  evacuation  of  military  resources. 

3)  Stratifying  errors  for  24,  48  and  72  h  forecasts 
based  on  various  parameters  such  as  location,  time  of 
year  and  various  tropical  cyclone  characteristics. 

4)  Determining  if  the  year-to-year  variations  in  fore¬ 
cast  accuracies  are  real  or  random  deviations  about  a 


1  Present  affiliation:  Science  Applications,  Inc.,  Lajolla.  CA. 
*  Presently  at  Offutt  Air  Force  Base,  Omaha,  NE. 


long-term  mean  and.  if  real,  determining  the  reasons 
for  the  variations. 

2.  Data  and  method  of  analysis 

The  Joint  Typhoon  Warning  Center  t  JTWC),  Guam, 
provided  forecast  and  "best  track”3  tropical  cyclone 
information  from  1966  through  1975  for  the  basic  sta¬ 
tistical  analysis.  The  data  set  included  the  24.  48  and 
72  h  official  forecasts  issued  by  the  JTW  C.'  Some  6150 
six-hourly  best  track  positions  for  some  317  tropical 
cyclones  (including  depressions,  tropical  storms  and 
typhoons)  were  examined.  Storms  so  short  lived  that 
forecast  verifications  were  precluded,  were  deleted  from 
the  data  set.  The  dissipation  of  storms  also  accounts 
for  the  reduction  of  cases  verified  as  forecast  range  in¬ 
creased.  The  verifying  cases  totaled  24  h,  4809  fore¬ 
casts;  48  h,  3038  forecasts;  72  h,  1372  forecasts.  The 
following  parameters  were  available  for  each  forecast 
initiation  time: 

1)  Maximum  wind 

2)  Latitude 

3)  Longitude 


•A  post-analysis  track  based  on  all  available  information. 

4  It  should  be  noted  that  JTWC  presently  incorporates  a 
number  of  objective  forecast  techniques  in  the  development  of 
their  forecasts,  including,  since  1975,  preliminary  results  from  a 
dynamic  model  forecast  scheme  presently  under  development  at 
the  Naval  Environmental  Prediction  Research  Facility  and  Fleet 
Numerical  Weather  Central. 
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Fig.  1.  Mean  error  stratifications  by  latitude  and  longitude 


4)  West-east  component  ("positive  to  the  east)  of 

tropical  cyclone  movement 

5)  South-north  component  'positive  to  the  north: 

of  tropical  cyclone  movement 

6)  Position  number  on  storm  track  (related  to 

warning  number  or  length  of  existence  of 
storm) 

7)  Number  of  storms  in  progress  at  forecast  time 

8)  Month 

9)  Error  distance  (forecast  position  to  best  track 

position) 

10)  Direction  from  forecast  position  to  best  track 
position. 

Similarly,  the  1976  data  were  provided,  but  retained 
separately  for  independent  testing.  In  this  data  set 
there  were  625  best  track  positions  at  six-hourly  inter¬ 
vals  for  25  tropical  cyclones  and  the  verifying  cases 


[ 


totaled  24  h,  524  forecasts;  48  h.  424  forecasts,  72  h, 
3.52  forecasts. 

The  1966-75  basic  data  set  was  then  examined  by 
stepwise  multiple  linear  regression  and  discriminant 
analysis  techniques  to  determine  basic  statistical  rela¬ 
tionships  between  parameters  and  hnd  parameters  re¬ 
lated  to  forecast  errors.  The  results  were  then  tested 
on  the  1976  data  set.  The  results  of  the  statistical 
analysis  were  also  used  to  examine  the  year-to-year 
variation  in  forecast  accuracy  as  well  as  the  trend 
during  the  11-vear  period. 

3.  Statistical  analysis 

Table  1  summarizes  the  means,  standard  deviations, 
and  the  error  variance  explained  bv  stepwise  multiple 
linear  regression  of  the  first  eight  variables  discusser 
above  for  the  24,  48  and  72  h  forecasts.  No  correlation 
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Table  1.  Basic  statist:  al  information  of  the  stepwise  multiple 
linear  regression  analysis  ( 1906-75  data'. 


Variance  , 

iX- 

Standard 

plained  {%) 

Variable 

Means 

deviation 

24  h 

48  h 

72  h 

Maximum  wind . 

m  s-1 

3d. 9 

14.8 

1.7 

0.7 

0.2 

dot) 

(  bo. 9) 

(  28.8i 

Lautude  (°N) 

18.7 

6.3 

4.2 

1.1 

0.6 

Longitude  (°E) 
West-easi  movement 

133.0 

14.6 

1.8 

2.3 

2.5 

m  s~‘ 

-2.8 

3.3 

0.1 

1.7 

1.5 

Get) 

South-north  movement 

(-5.5) 

(  6.4) 

m  s'1 

2  0 

2.1 

0.3 

0.3 

0.1 

(kt) 

(  4.0) 

1  4.1) 

Position  Xo. 

13.5 

10.6 

NE" 

NE 

NE 

Number  of  storms 

1.5 

0.7 

0.3 

0.2 

NE 

Month 

"rror  distance  24  h 

8.7 

2.3 

NE 

NE 

0.1 

km 

233 

150 

in  mii 

1 125.7 1 

;  80.8) 

Error  distance  48  h 

km 

458 

285 

(n  mi) 

Error  distance  72  h 

(247.0) 

(153.8' 

km 

085 

419 

fn  mi) 

1369.4) 

(226.0) 

Total  variance  explained  {%) 

10.5 

8.8 

6.6 

*  NE:  Was  rejected  in  linear  regression. 


coefficient  of  any  available  predictor  with,  the  magni¬ 
tude  of  the  errors  (at  either  24,  48  or  72  h)  exceeded 
0.185,  and  the  total  explained  variance  of  the  error 
distance  did  not  exceed  1 1%.  The  variables  contributing 
most  to  the  explained  variance  were  the  maximum 
wind,  latitude,  longitude,  west-east  movement  and 
south-north  movement.  The  concept  of  predicting  the 
error  was  then  oriented  toward  discriminant  analysis 
where  forecasts  could  be  identified,  and  hopefully 
forecast,  as  either  'good”  or  "bad.”  This  will  be  dis¬ 
cussed  later. 

In  order  to  examine  the  forecast  errors  in  more 
detail,  the  errors  were  stratified  and  mean  errors  were 
computed  for  each  stratification  along  the  range  of 
each  variable.  Significant  trends  were  evident.  In  this 
analysis,  stratifications  were  selected  to  keep  the  num¬ 
ber  of  cases  in  each  group  relatively  high.  As  an  aid 
in  interpreting  the  forthcoming  figures,  relative  fre¬ 
quencies,  all  based  on  4809  cases,  are  shown  for  the 
24  h  forecasts.  Since  they  are  in  percentages  of  the 
total,  the  frequencies  roughly  apply  also  for  48  and  72  h 
forecasts.  Actual  frequencies  are  typically  a  few  hundred 
and  are  not  indicated  except  where  they  drop  below  100. 

In  each  of  the  24,  48  and  72  h  forecast  situations, 
the  mean  forecast  errors  were  minimal  at  lower  latitudes 
(Fig.  la),  gradually  increasing  with  latitude.  This 
indicates,  as  expected,  that  storms  are  more  accurately 
forecast  before  they  recurve  and  move  into  higher 
latitudes.  Mean  forecast  errors  decrease  with  decreas¬ 


ing  east  longitude  Fig.  lb  I.  Generally,  a  forecast  for 
a  storm  ;n  a  more  westerly  position  is  one  based  on  a 
longer  than  average  history,  and  is  in  an  area  of  better 
synoptic  data  and  land  radar  coverage,  given  the 
proximity  to  the  Philippines,  Taiwan.  Japan  and  the 
continental  area  west  of  13t)°E. 

The  geographic  variations  of  mean  24  and  48  h 
forecast  errors  can  be  seen  in  Fig.  2.  This  figure  dramati¬ 
cally  shows,  for  example,  the  difference  between  tropical 
cyclone  forecast  errors  for  tropical  cyclones  affecting 
the  Philippines  vs  those  affecting  the  Japan  Korea  area. 

Maximum  wind  -  Fi».  3:  is  another  important  pa¬ 
rameter.  The  mean  errors  decrease  with  increasing 
maximum  wind  speeds,  indicating  that  better  developed 
tropical  cyclones  with  longer  histories  and  more  ac¬ 
curate  center  locations  are  more  accurately  forecast. 
This  general  trend  is  visible  for  all  three  forecast  times. 

Forecasts  are  generally  better  fur  tropica!  cyclones 
moving  west  (Fig.  4a  and  become  progressively  more 
difficult  as  westward  movement  diminishes  and  be¬ 
comes  eastward  as  associated  with  recurvature.  As  for 
the  south- north  component  (Fig.  4b/.  the  best  fore- 


Fic.  2.  Geographic  distribution  of  moan  24  h  and  48  h  forecast 
errors  for  wo- tern  North  Pacino  tropical  cyclones.  Errors  are 
based  on  1906-75  data  and  relate  to  mean  forecasts  from  initial 
positions  Values  are  given  in  km  (  )  and  n  mi. 
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Fig.  3.  Mean  error  stratifications  by  maximum  wind. 


casts  are  centered  at  or  near  zero,  again  implying 
better  forecasts  when  the  storm  is  moving  west  with 
little  or  no  deflection  north  or  south.  Errors  increased 
markedly  for  storms  moving  south,  as  well  as  for 
tropical  cyclones  moving  north,  as  would  be  associated 
with  recurvature. 

Fig.  Sa  shows  the  number  of  tropical  cyclones  oc¬ 
curring  simultaneously  is  related  to  an  increasing  fore¬ 
cast  error.  This  is  reinforced  by  Fig.  5b,  which  examines 
distance  to  the  nearest  storm  as  a  function  of  forecast 
error.  With  tropical  cyclones  in  close  proximity — less 
than  1112  km  (600  n  mi) — forecast  errors  increase 
dramatically.  The  time  of  year  also  relates  to  number 
of  tropical  cyclones  occurring  simultaneously  and  the 
monthly  variation  of  forecast  errors  can  be  seen  in 
Fig.  5(c).  The  peaic  months  of  tropical  cyclone  activity 
produces  generally  larger  errors  at  24  h.  This  trend 


becomes  progressively  less  evident  at  longer  forecast 
ranges. 

The  number  of  6  h  points  along  the  track  (Fig.  6a).  a 
measure  of  the  length  of  storm  history,  showed  a  trend 
congruous  with  that  of  maximum  wind:  as  the  storm’s 
history  and  development  increased,  the  forecast  errors 
decreased.  This  trend  also  becomes  less  apparent  as 
forecast  range  increases  from  24  and  72  h. 

The  last  variable,  initial  position  error  (Fig.  6b)  was 
e”aluated  using  initial  “warning  position”5  data  avail¬ 
able  from  1971-1975.  A  consistent  and  prominent  trend 
shows  the  mean  forecast  errors  increasing  as  the  initial 
position  errors  increase.  This  supports  the  basic  fore- 

‘  The  “warning  position"  is  the  position  the  forecaster  feels  , 
the  tropicau  cyclone  is  located  at  time  of  issuance  of  the  forecast. 
The  distance  between  the  warning  position  and  the  post  analysis 
best  track  position  is  the  initial  position  error. 
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casting  premise  that  accurate  observations  are  neces¬ 
sary  for  accurate  forecasts.  This  finding  is  in  general 
agreement  with  the  findings  in  the  Atlantic  of  Neumann 
and  Hope  (1972),  Neumann  (1975),  and  Sanders  and 
Gordon  (1976),  who  found  that  for  Atlantic  hurricanes, 
the  initial  position  error  was  important  in  objective 
forecasts. 

The  slope  of  the  relationship  of  initial  position  error 
to  forecast  error  is  interesting.  A  23.2  km  (12.5  n  mi) 
increase  in  initial  position  error  relates  to  a  37.1  km 
(20  n  mi)  increase  in  24  h  average  forecast  error.  A 
strong  relationship  also  exists  at  48  h  and  even  at  72  h. 
This  is  an  important  consideration  since  initial  position 
error  can  be  related  to  reconnaissance  platforms  and 
hence,  subject  to  some  control.  This  will  be  discussed 
in  more  detail  later. 

To  this  point,  the  forecasts  (and  hence,  forecast 


errors)  have  been  tacitly  assumed  to  be  independent  of 
each  other.  In  reality,  successive  6  h  forecasts  for  a 
particular  storm  are  strongly  correlated.  This  can  be 
seen  in  Table  2,  which  gives  the  estimated  autocorrela¬ 
tion  coefficients  between  errors  from  successive  forecasts 


Table  2.  Autocorrelations  between  forecast  errors  of 
successive  forecasts. 


Time  lag 

(h) 

Forecast  period 

24  h  48  h  72  h 

0 

1.000 

1.000 

1.000 

6 

0  665 

0.790 

0.838 

12 

0.432 

0.587 

0.685 

18 

0.291 

0.432 

0.476 

24 

0.213 

0.305 

0.371 

30 

0.173 

0.212 

0.127 

36 

0.181 

0.171 

0.177 

Vol.LME  100 


930 


M  ON'TH  L  V  VV  E  A  THER  REVIt  U 


Fio.  5.  Mean  error  stratifications  by  number  of  tropical  cyclones  occurring  simultaneously,  distance  to  the  nearest  storm  and  month. 


with  lag  times  out  to  36  h.  It  can  be  seen  that  auto¬ 
correlations  increase  as  the  forecast  interval  increases. 

The  UCLA  Biomedical  computer  program  BMDP7M 
(Dixon,  1975)  was  used  to  attempt  to  discriminate  be¬ 
tween  forecasts  likely  to  produce  large  errors  and  those 
likely  to  produce  small  errors.  The  cases  were  classed 
in  three  groups  according  to  their  known  24  h  errors. 
Group  1  consisted  of  cases  where  the  magnitude  of  the 
error  was  less  than  the  median  in  both  \V-E  ana  7,-  N 
components.  Group  2  had  one  component  above  the 
median  and  the  other  below  the  median  while  Group  3 
had  both  components  above  the  median.  The  per¬ 
centage  of  cases  falling  into  Groups  1,  2  and  3  was  30. 
46  and  24%,  respectively. 


The  discriminators  made  available  for  the  analysis 
were  those  variables  previously  discussed  which  were 
shown  to  be  related  to  error  magnitude  and  would  be 
known  to  the  forecaster  as  he  made  his  forecast.  These 
were  1)  latitude,  2)  longitude.  3)  maximum  wind,  4' 
number  of  storms  in  progress,  5>  and  6)  the  two  com¬ 
ponents  of  motion  over  the  previous  12  h,  7)  month, 
and  8)  distance  to  the  nearest  “other”  storm,  if  one 
was  present ,  otherwise  a  large  default  number  was  as¬ 
signed.  Of  the  above  parameters  the  first  six  were 
selected  by  the  analysis  program  as  significantly  con¬ 
tributing  to  discrimination.6 


"  The  resulting  classification  functions  are  shown  in  the  appendix. 
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Fio.  6.  Mean  error  stratifications  by  point  on  track  (position  number  which  is  related  to  life 
cycle  or  length  of  existence  of  tropical  cyclone)  and  initial  position  error. 


When  the  classification  functions  vvere  applied  to 
the  dependent  data,  those  identified  as  Group  1  were 
typically  well  developed  tropical  cyclones  (typhoon 
intensity)  in  the  western  part  of  the  region  at  low 
latitudes  and  moving  generally  west. 

Forecasts  classed  as  Group  3  were  typically  during 
or  after  recurvature  and  included  the  total  spectrum  of 
tropical  cyclone  intensities.  Group  2  included  many 
low  latitude  weak  depressions  or  tropical  cyclones  of 
all  intensities  at  or  near  typical  recurvature  latitudes 
but  not  as  yet  exhibiting  recurvature.  Also  included  in 
Group  2  were  many  otherwise  Group  1  cases  in  multiple 
storm  situations. 

The  forecast  error  distributions  are  illustrated  in 
Fig.  7  by  means  of  40%  probability  ellipses  based  on 


the  assumption  of  a  bivariate  normal  probability  dis¬ 
tribution.  Ellipses  are  given  for  each  group  for  24.  48 
and  72  h  forecasts  although  the  discriminant  analysis 
was  based  on  24  h  errors  only.  The  most  prominent 
difference  in  the  three  sets  of  ellipses  is  their  size.  The 
area  within  each  of  the  Group  1  ellipses  is  roughly  half 
that  of  the  corresponding  Group  3  ellipses  and  about 
two-thirds  that  of  the  corresponding  Group  2  ellipses. 
The  orientation  of  the  major  axis  is  similar  for  all  three 
groups. 

The  bias  or  offset  of  the  ellipse  center  from  the 
diagram  origin  is  strikinc  for  Group  2.  The  bias  to  the 
southwest  means  forecasts  were,  in  the  mean,  too  far 
northeast.  This  could  be  the  result  of  over  anticipation 
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Fig.  7.  The  40%  probability  ellipses  for  each  forecast  interval 
for  Group  J,  Group  2  and  Group  3  forecasts.  The  origin  is  the 
forecast  position  with  each  ellipse  center  the  average  verifying 
position  relative  to  forecast  position. 

of  recurvature.7  Although  the  bias  is  much  less  for 
Group  3,  it  is  in  the  opposite  direction  perhaps  due  to 
the  underestimation  of  the  acceleration  of  recurved 

7  As  an  example  for  a  single  year,  the  1967  tropical  cyclone 
season  had  many  east-west  moving  tropical  cyclones  with  below 
average  number  of  recurving  tropical  cyclones.  The  72  h  forecast 
error  bias  was  172  km  (93  n  mi)  to  the  southwest  for  Group  2 

cases. 


tropical  cvo’-nt  I'hi-  G.is  u.  >■■.  -  igo '  •  ■  :h« 

west  for  Group  I.  >int«-  tin.—-  •  .1-  ■  *->t 

moving  tropic  a  i  cu  .••no.  :m-  •  <...  .  ::  -. 

in  the  mean  slight!)  itndcrlorr.  i-t 

The  1976  cases  were  toted  lor  o'  un--  v,rs--.-  fir  7 
ability  ellipses  constructed  on  tire  depend- m  data,  l  ie 
■S  shows  the  results  this  u-t.  It:  e,i.  .  '  .-•  v 
graphs  the  45°  line  represents  rite  expect'."  1  result  v  i.t.v 
the  dots  connected  bv  line  segments  rt-pre-ent  t(ie  ob¬ 
served  fit.  The  maximum  deviation  is  indicated  by  a 
vertical  arrow.  Using  the  kolomogorov-Sntirnov  test 
'Massey,  195 1  j  based  on  the  effective  number  of  inde¬ 
pendent  cases,  none  of  these  differences  are  signitu.  ar.i 
at  the  5%  level.'  The  ellipses  were  generally  conserva¬ 
tive  because  1976  forecasts  were  better  than  the  10-year 
average  reflecting  in  part  a  general  improvement  of 
forecasts  over  the  eleven  years  involved. 

For  contrast  the, Group  3  and  Group  1  forecasts  were 
interchanged  and  the  ellipses  were  again  tested.  Fig.  9 
shows  the  results  of  this  test.  The  Group  1  forecast 
errors  are  clearly  not  represented  well  by  the  large 
Group  3  ellipses  and  converse!)  the  Group  5  forecasts 
are  poorly  represented  by  the  Group  1  ellipses. 

4.  Annual  variability 

Perhaps  the  most  interesting  facet  of  the  examination 
of  tropical  cyclone  forecast  errors  is  the  extent  of 
annua)  variability  and  possible  reasons  for  the  varia 
tions.  Fig.  10a  shows  the  annual  r.iear  errors  for  the 
11  years  1966-76.  The  picture  has  been  described  as 
a  steady  improvement  to  a  minimum  in  errors  in  1970. 
then  an  unsteady  but  generally  worsening  trend  in  the 
years  since.  The  least  squares  trend  lines  indicate  minor 
improvement  over  the  total  period ;  however,  the  slopes 
are  too  shallow  to  be  conclusive. 

A  number  of  factors  have  been  examined  to  isolate 
reasons  for  the  large  year  to  year  variability.  The  per¬ 
formance  of  objective  forecast  techniques  tends  to 
parallel  that  of  the  official  forecasts.  Fig.  10b  shows 
the  annual  variation  of  simple  linear  extrapolation,  or 
persistence  of  the  past  12  h  motion  vector,  as  a  forecast 
technique.  The  persistence  error  depicts  a  measure  of 
how  well  behaved  or  linear  the  tracks  were.  This 
extrapolation  is  based  on  “best  track”  or  post  analysis 
positions.  Of  course  the  forecaster  faces  uncertainty  in 
the  location  and  recent  history  of  the  tropical  cyclone. 
Nevertheless,  the  similarity  in  the  two  curves  illus¬ 
trates  the  vulnerability  of  the  forecasting  system  to 
major  track  or  speed  changes. 

•  Because  of  high  autocorrelation,  consecutive  forecasts  on 
the  same  tropical  cyclone  cannot  be  considered  independent 
Following  Brooks  and  Carruthers  (19531.  the  equivalent  number 
of  independent  cases  f.V,i  was  estimated  by  X.  --  ,Yt  1  —  r)1 / 
fl  —  r1— (1  —  rd/cl,  where  .V  is  the  total  number  of  cases,  r  is  the 
autocorrelation  coefficient,  and  c  is  in  the  average  number  of 
cases  per  tropical  cyclone.  For  24,  48  and  72  h.  respectively. 
.V,  =  0.24.Y.  0.18.Y  and  0.54 .Y  using  ir.cl  values  of  (0.665,17', 
(0.790.11)  and  (0.685,5). 
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Fig.  8.  The  1976  verifying  positions  that  fell  into  25,  50,  75,  90  and  95r7  probability  ellipses 
by  Group  and  Forecast  (24,  48  and  72  h).  Maximum  deviation  is  indicated  by  vertical  arrow. 
“Observed”  is  the  ordinate,  and  “expected”  is  the  abscissa. 


Another  measure  of  variability  is  the  type  of  fore-  the  JTWC  based  on  aircraft  reconnaissance  and  satel- 
casts  which  make  up  a  year.  That  is,  the  percentage  of  lite  data.  There  is  qualitative  correspondence  between 
the  year  made  up  of  the  type  expected  to  give  large  large  percentages  of  warnings  based  on  reconnaissance 
errors  versus  those  expected  to  give  small  errors.  In  in  the  middle  years  and  generally  lower  forecast  errors. 
Fig.  10c,  the  annual  mean  group  numbers  (from  the  Forecast  errors  are  larger  with  the  lower  percentage  of 
previously  presented  descriminant  analysis)  are  shown,  warnings  based  on  reconnaissance  data  in  the  earlv 
Above  average  group  numbers  would  be  indicative  of  a  and  the  later  years.  In  the  years  after  1971  satellite 
difficult  year,  whereas  below  average  relate  to  an  easy  data  has  to  some  extent  replaced  reconnaissance,  but 
year.  The  general  characteristics  of  the  curves  of  Fig.  as  indicated  previously  initial  position  error  is  highlv 
10c  follows  those  of  Fig.  10a  with  correlation  coeffi-  related  to  forecast  error  and  the  initial  position  error 
dents  of  0.61,  0.68  and  0.61  at  24,  48  and  72  h,  for  reconnaissance  is  less  than  for  satellite  data.  For 
respectively.  1976  the  initial  position  error  was  32.8  km  (17.7  n  mi 1 

Fig.  lOd  shows  the  percentage  of  warnings  issued  by  for  aircraft  reconnaissance  versus  56.5  km  (30.5  n  mil 
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Fic  9.  The  1976  verifying  positions  that  fell  into  25,  50.  75.  90  and  95%  probability  ellipses 
for  Group  1  into  Group  5  ellipses  and  Group  J  into  Group  1  ellipses  for  2-4.  4b  ar.c.  72  h. 
Maximum  deviation  is  indicated  by  vertical  arrow.  “Observed"  is  the  ordinate,  and  “expected'' 
is  the  abscissa. 


ior  DM3P.J  It  seems  apparent  that  the  reduction  of 
aircraft  reconnaissance  has  had  an  impact  on  the  fore¬ 
cast  errors.  In  addition,  in  the  years  since  1971,  air¬ 
craft  reconnaissance  in  the  western  North  Pacific  has 
not  had  the  use  of  the  powerful  APS-20- radar  which 
provided  excellent  tropicai  cyclone  ''stand-off”  fix 
capability. 

.Another  factor  which  has  changed  at  the  JTWC  in 
recent  years  is  numbers  of  duty  officers  or  forecasters. 
The  number  of  forecasters  has  historically  been  six: 
the  Director,  Operations  Officer,  and  four  duty  officers. 
As  can  be  seen  by  Fig.  lOe,  the  number  of  duty  officers 
has  been  increased  in  recent  years,  ft  is  certainly 
not  clear  that  this  increase  has  led  to  an  improve¬ 
ment  in  forecasting.  But  the  question  is:  has  there 
been  an  improvement  in  forecasting  in  recent  years? 

A  major  objective  of  this  study  was  to  examine  this 
year  to  year  variation  in  the  forecasting  system.  This 
is  useful  not  only  as  a  basis  for  evaluating  the  effective¬ 
ness  of  the  system,  but  serves  a  more  important  pur- 


*  It  should  also  be  pointed  out  that  the  DMSP  program  has 
been  particularly  beneficial  or  cost  saving  in  the  reduction  of  in¬ 
vestigative  aircraft  missions  which  are  flown  when  the  develop¬ 
ment  or  formation  of  a  tropical  cyclone  is  imminent. 


pose.  Over  the  next  few  tears  the  tropical  cyclone 
warning  system  in  the  western  North  Pacific  will  rely 
increasingly  on  dynamic  models  as  a  major  input.  It 
is  then  important  that  a  base.ine  be  established  for 
relatively  short  term  evaluation  of  the  system,  hope¬ 
fully  to  measure  improvements,  but  also  as  a  guard 
against  system  degradation. 

To  establish  such  a  baseline  the  year  to  year  per¬ 
formance  must  be  normalized  or  adjusted.  Annual  mean 
error  is  a  poor  measure  of  performance  because  clearly 
some  years  are  heavily  loaded  with  difficult  forecasts 
and  others  weighted  toward  easier  forecasts.  As  a 
normalizing  tool,  a  measure  of  difficulty  is  necessary. 
The  distribution  of  forecasts  into  the  three  groups 
presented  earlier  is  one  possible  measure.  The  mean 
group  number  explains  about  40%  of  the  year-to-year 
variance  in  mean  error.  Another  important  component 
of  error  is  how  persistent  the  tracks  were.  The  annual 
persistence  error  explains  from  30  to  50%  of  the  annual 
variance.  Clearly  these  two  measures  are  not  indepen¬ 
dent.  Their  correlations  decrease  in  time  from  about 
0.5  at  24  h  to  0.25  at  72  h.  Anorher  important  determi¬ 
nant  of  forecast  error  is  the  error  in  the  initial  position. 
This  error  is  assumed  to  be  independent  of  group  num- 
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ber  and  persistence  error  ,  when  persistence  is  based  on 
the  "best  track”'.  Initial  position  error  has  been  docu¬ 
mented  on  a  case  by  case  basis  since  1971  and  annual 
means  are  available  since  1970.  There  are  other  factors 
such  as  the  introduction  of  objective  techniques,  in¬ 
creased  knowledge  concerning  the  behavior  and  char¬ 
acteristics  of  tropical  cyclones,  improvements  in  thc 
mid-iatitude  prognostic  models,  data  (synoptic  and 
satellite;  availability,  and  changes  in  personnel.  These 
are  less  tangible  and  will  for  the  moment  be  ignored. 

A  system  of  handicapping  the  annual  errors  has  been 
devised  to  adjust  for  annual  forecast  difficulty  and  the 
variability  in  initial  position  error  or  more  specifically 
reconnaissance  support.  The  first  component  of  the 
handicapping  system  is  an  estimate  of  annua!  error 
based  on  a  two-predictor  least-squares  regression  equa¬ 
tion.  The  predictand  is  annual  error  (AE  in  km)  and 
the  predictors  are  the  annual  mean  group  number  <G) 
and  the  annual  mean  persistence  error  IP  in  km)  as 
follows : 

AE24=-76.4+0.779P1,4-)-79.1G':m  (1) 

AE„=  —86.5+0.7487’  «+112.SC\,  (2) 

AE,,=  -  227.0+0. 738/>rj+ 207. 1C, ...  (3) 

These  equations  explain  43,  62  and  79%  of  the  variance 
in  the  annual  mean  errors  at  24, 48  and  72  h,  respectively. 

The  second  component  of  the  handicap  is  based  on 
the  percent  of  forecasts  issued  where  the  initial  position 
was  based  on  aircraft  reconnaissance.  This  percentage 
is  known  for  the  11-year  period.  This  percentage  was 
converted  to  an  equivalent  annual  mean  initial  position 
error  by  assigning  33.3  km  (18  n  mi)  as  the  initial 
position  error  for  reconnaissance  based  tropical  cyclone 
forecasts  i  Harrison,  1975  and  Pilipowskvj,  1977)  and 
using  the  known  initial  position  errors  (from  1970-76) 
to  deduce  the  initial  position  error  value  based  on 
“other”  types  of  fixes.  These  "other”  types  include 
land  and  ship  radar,  satellite  data,  extrapolation  and 
synoptic  data.  This  average  was  found  to  be  64.8  km 
(35  n  mi).  The  relationship  between  forecast  error 
(E  in  km)  and  initial  position  error  (£0  in  km)  as  w  as 
shown  graphically  in  Fig.  6(b)  is 

£21—  154.3+ 1.6£0 

=  154.3+1.6[33.37?+64.8(1.0-£)],  (4) 
£«=363.2+  2.4£o 

-=363.2+2.4[33.3£+64.8(1.0-£)],  (5) 
£72  —  61 7.0+2.0£o 

=  617.0+2.0[33.37?+64.8<T.0-£)],  (6) 

where  R  is  the  fraction  of  warnings  during  the  year 
that  were  based  on  aircraft  reconnaissance. 

The  two  handicaps  were  each  reduced  by  the  mini¬ 
mum  of  the  eleven  annual  values.  The  1973  season  for 
instance,  the  least  difficult  year  based  on  Eqs.  (1) 
through  (3),  was  then  assigned  a  zero  handicap  for 


1966  67  68  69  70  71  72  73  74  75  76 


Fig.  10.  The  annual  variation  of  fat  mean  tropical  cyclone 
official  forecast  error,  (b.i  mean  persistence  error,  (c )  mean  Group 
number,  (d)  percentage  of  warnings  based  on  reconnaissance  and 
satellite  and  (e)  number  of  JT\VC  duty  officers. 

difficulty.  Similarity  in  1968  and  1969.  when  95%  of 
the  forecasts  were  based  on  aircraft  reconnaissance,  a 
zero  handicap  for  reconnaissance  was  assigned.  Finally 
the  annual  mean  errors  were  reduced  by  the  sum  of 
the  two  handicap  components.  Fig.  1 1  is  the  "unex¬ 
plained  error.”  The  trend  is  more  consiste’nt  than  the 
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Fit;.  II.  Annual  mean  forecast  errors  adjusted  by  removal  of 
elements  of  the  annual  variation  of  persistence,  forecast  difficulty 
and  initial  position  error. 

error  trend  of  Fig.  10aw  and  reflects  in  part  the  “pay-off” 
or  result  from  research  efforts,  i.e.,  improved  fore¬ 
casting  aids  and  numerical  output,  and  a  better  under¬ 
standing  of  the  tropical  cyclone  and  its  surrounding 
environment.  Also  in  the  trend  line  is  the  result  of 
more  realistic  manning  of  the  JTVVC  in  terms  of  the 
number  of  forecasters  as  well  as  any  change  in  the 
quality  or  skill  level  or  even  motivation  of  the  personnel. 

It  is  difficult  to  assess  the  net  change  in  the  observa¬ 
tional  network  over  this  eleven  year  period.  There 
have  been  some  losses,  most  notably  a  large  reduction 
in  ship  reports,  particularly  in  the  South  China  Sea 
with  the  Post-Vietnam  reduction  of  Navy  and  Depart¬ 
ment  of  Defense  contract  vessels.  There  have  also  been 
some  reductions  in  upper  wind  reporting.  These  have, 
in  part,  been  offset  by  greatly  improved  satellite  sup¬ 
port  particularly  with  the  DMSP  in  1971  and  later 
years  although  there  have  been  periods  when  this  sup¬ 
port  left  much  to  be  desired.  As  evident  from  Fig.  lOd, 
reconnaissance  support  has  eroded  significantly  from 
two  squadrons  (Navy  and  Air  Force)  to  a  present  day 
single,  smaller,  Air  Force  squadron. 

There  has  long  been  concern  over  the  rapid  turnover 
of  personnel  at  the  JTWC.  The  tour  length  is  two 
years.  A  new  Director,  who  is  a  dominating  force  in 
the  forecast  system,  was  on  hand  for  the  1967  season 
and  for  each  odd  year  thereafter.  The  apparent  saw¬ 
tooth  pattern  in  Fig.  11  supports  this  concern.  For  the 
five  two-year  tours,  the  24  h  errors  were,  on  the  aver¬ 
age,  10%  greater  in  the  odd  or  first  year  as  compared 
to  the  even  years.  The  48  and  72  h  forecasts  showed 
similar  but  less  distinct  numerical  changes. 


10  The  adjusted  error-year  correlation  is  approximately  0.6  as 
compared  to  the  actual  error-year  correlation  of  0.3  for  Fig.  10(a). 


5.  Summary  and  recommendations 

In  light  of  the  objectives  outlined  earlier,  ior  the 
most  part,  the  goals  of  the  study  have  been  attained. 
It  has  been  demonstrated  that  a  small  number  of 
readily  available  parameters  can.  with  reasonable  effec¬ 
tiveness,  classify  a  tropical  cyclone  forecast  as  likely 
resulting  in  either  markedly  above  or  below  average 
errors.  Group  1  forecasts  have  a  high  probability  of 
below  average  errors  with  a  low  probability  of  above 
average  errors.  Group  2  forecasts  have  approximately 
equal  probabilities  of  being  above  or  below  average. 
Group  3  forecasts  have  a  low  probability  of  below 
average  errors  witff  a  higher  probability  of  above 
average  errors.  It  was  found  that  the  error  probability 
ellipses  for  all  three  groups  are  oriented  approximately 
the  same  (major  axis — northeast  to  southwest),  but  the 
area  of  the  Group  I  ellipses  was  roughly  hall  of  the 
area  of  the  Group  3  ellipses.  In  addition  the  year-to- 
year  variation  in  forecast  errors  over  the  past  11  years 
in  the  western  North  Pacific  appears  to  show  continued 
improvement,  once  the  errors  are  adjusted  for  the 
annual  biases  present,  which  contribute  either  nega¬ 
tively  or  positively  to  the  forecast  errors. 

The  examination  of  additional  parameters  could  im¬ 
prove  the  identification  of  potentially  poor  f recasts. 
Initial  position  error,  which  was  shown  to  be  directly 
related  to  forecast  errors,  was  not  introduced  as  a  dis¬ 
criminator  because  it  is  not  generally  known  to  the 
forecaster  at  the  time  of  the  forecast.  In  addition,  the 
synoptic  patterns  associated  with  the  tropical  cyclone 
have  not  been  considered.  Parameters  which  are  as¬ 
sociated  with  such  features  as  the  Tropica!  Upper 
Tropospheric  Trough  (TUTT),  subtropical  ridges  and 
transient  troughs  in  the  westerlies  might  prove  to  be 
important  discriminators  especially  siri.e  t hey  many 
times  relate  to  the  basic  problem  of  tropical  cyclone 
recurvature. 

Two  primary  sources  of  error  are  implicit  from  the 
statistical  analysis:  1)  those  related  to  the  recurvature 
phenomena — whether  to  forecast  recurvature  or  not 
and  in  the  speed  of  motion  after  recurvature— and  2' 
those  errors  associated  with  initial  positioning.  Re¬ 
search  aimed  at  these  sources  offers  considerable  po¬ 
tential  for  improvement  in  tropical  cyclone  forecasting. 
The  greatest  hope  for  the  solution  of  the  recurvature 
problem  may  lie  with  dynamic  models,  but  synoptic 
and  statistical  studies  should  not  be  ignored. 

The  positioning  problem  suggests  improvement  in 
the  observational  system.  While  more  and  better 
equipped  aircraft  is  a  possible,  and  perhaps  expedient 
solution,  developments  in  the  satellite  area  may  be  the 
ultimate  solution.  This  may  involve  finding  a  different 
and  more  conservative  way  to  define  the  location  ol  a 
tropical  cyclone  other  than  the  so-called  eye  or  esti¬ 
mated  center. 

A  further  application  of  the  statistical  base  presently- 
established  would  be  to  derive  “threat”  or  “strike” 
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Fig.  12.  The  ‘'strike"  probability  of  Typhoon  Fran  (1800 
GMT  6  September  1976'  passing  through  the  shaded  area  relative 
to  Kadena  Air  Base.  Okinawa.  The  probabilities  are  based  on 
the  forecast  track  and  the  error  distributions  for  this  type  of 
tropica!  cyclone,  ft  should  be  noted  that  Typhoon  Fran  did  in 
fact  miss  the  shaded  area  as  the  storm  passed  to  the  east  of 
Okinawa. 

probabilities  tor  specific  locations  in  the  western  North 
Pacific.  For  example.  Fig.  12  gives  the  probability 
integrated  over  an  area  139  km  (75  n  mi'  to  the  left 
and  93  km  (50  n  mi)  to  the  right  of  Kadena  Air  Base, 
Okinawa  relative  to  the  forecast  track  of  Typhoon  Fran. 
The  integration  is  also  performed  over  time  from  that 
initial  time  of  1800  GMT.  7  September  1976  to  a  time 
12,  24.  48  and  72  h  later. 
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and  the  suggested  area  of  study  by  Capitan  A.  T. 
Buckmaster,  USX.  is  much  appreciated. 

APPENDIX 

Classification  Functions 

The  discriminant  analysis  resulted  in  three  functions 
which  are  linear  combinations  of  six  variables : 

Coefficients 

Variable  Function  1  Function  2  Function  3 

Latitude  (deg)  —0.06439  0.08352  0.04238 

Longitude  (deg)  —0.03231  0.00274  —0.03928 


this  pa;.:f  ts  b°:-t  cuality  p:d.:ti:jPle 

FROMLd,  .  -  •  •• 


4  D  A  VI)  D  .  S  .  V  ICKl.1  N  937 


Maximum  wind  (m  s'1 

0.0437 : 

0.02694 

-  0.00239 

S-N*  movement  <m  s-;i 

— *1.1571*' 

0  218)58 

-0.06587 

W’-E  mo\  emen  t  i  rn  s  '1  / 
Number  of  storms  in 

-0.04932 

-0.18310 

0.01311 

progress 

—  O.2609O 

0.0!  186 

1 .05585 

Constant 

4.6651 1 

-3.81310 

3  14344 

The  values  of  the  functions  at  the  group  mean  for  each 
variable  are  as  follows: 


Function  i  Function  2  Function  .5 

Group  1  0.360*9  0  05017  -0.01138 

Group  2  -  0  0+093  -  0.07138  0.01683 

Group.)  -0.36186  0.07454  -0.01S22 

In  order  to  determine  which  group  a  forecast  would 
fall  into,  each  of  the  functions  /,  for  :=1.  2.  3  are 
evaluated  using  the  known  actual  values  lor  the  six 
variables.  A  squared  distance  is  then  determined  from 
the  group  mean  value  ‘u.  T  for  the  3  functions  <i)  and 
the  three  groups  ik  =  1,  2.  5'  v  it  It  the  equation 

Dr=Y*  (J.  — "■..<)-■ 

■-1 

The  forecast  is  assigned  to  the  group  k<  corresponding 
to  the  minimum  Dt?  value. 
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